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ABSTRACT 

In order to <Iet«:;i i«ine vhether Appalachia Educational 
Laboratory (AEL) had the capability of producing a TV series of high 
technical quality with content that met criteria designed for the 
selection of children's television programs^, a pilot tape produced by 
AEL was submitted for rating to educational television (ETV) 
specialists from the S^ate Departments of Education serviced by AEL 
and other ETV facilities. Most of the specialists reacted favorably 
to the tapes in terras of meeting the selection criteria, providing a 
variation in character images, and exhibit. technical quality. Many 
felt that a series similar to the pilots wou, be suitable for use in 
their areas. Several individuals did indicate concern over the 
relative emphasis of children versus adults, the reality of the 
situations, and the advanced level of the vocabulary used in the 
tapes., ETV personnel from AEL's geographical region gave more 
positive ratings than did other ETV personnel. Based on these 
responses, it appears that AEL has demonstrated its capability of 
producing TV tapes which exhibit technical quality and meet the 
selection criteria for children's programs. {HDR} 
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Educational 'i^^levision rt-onncl ^ s Roviow of the Techniccil Quality, 
Content Cri toria, and Markotcibi lity of /M-:l's 
'^Around the Bend" rilot Tapes 

A television series for 3-, 4-, and L^-yoar-old cluldren in Appalachia 
is currently being planned by the Appalachia Educational Laboratory (AEL) . The 
series is to be an integral co:nponent of the Home-Oriented Preschool Education 
(HOPE) program; a program designed to meet the educational needs of chil.drcn 
in the Aj.^palachian Region, Hov;ever, the capability of A?:l to produce a tele- 
visioj:i series which is of high technical quality was questioned by the National 
Institute of Education (NIE) during an evaluation conducted by NIE in the Fall 
of 1972. An NIE specialist panel recommended "that AEh initiate development 
of the proposed marketable I'V series", ^ Dr, Thomas K. Glennan, Director of 
the WIE, then directed AEL to explore and document the capability of development 
of a p^rogram, and stated that reviewers had "noted certain problems with 
respect to "he technical quality of your marketable preschool education program" 

In accordance v;\th tlie NIE communications, the purpose of this report is 
to document the capability of AEL to produce a television program of adequate 
technica]. quality. This report also documents the degree to v;hich the content 
of the television program meets criteria designed for the selection of children' 
television programs . 

Ed uca tj . ov^ a 1 Te 1 e v i si o 1 1 J^^C£ sonne 1 Input 

Input about AELVs TV programs from educational television (ETV) personr^cl 
is considered very valuable for product development. The ETV specialists have 
presented indications of and possibilities for imp]ementation of the TV series 

^Specialist P^triel Verification Reviev;, October 9-10, 1972, p. 5, by 
November 22, 1972, mcmoranduia from Dr. Marc S. Tucker, Task Force on Lalj/Center 
Transition . 

'^By letter dated November 10, 1972. 
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at U^oir facil.it.loy. The forraation of an advisory cjroup of ETV porsonnol 
is proviclituj valuable input duriruj the development of the W scries for the 
}iOPE program. The review of tho pilot tapes is providing M:L wit)) KTV 
speciaiistG' ratings of the tapes, as compared to other ETV offerings. 

To insure a television 2:>rogram of high technical quality, the tele- 
vision studios of 21st Century Productions (VJLAC-TV) , Nashville, Tennessee, 

v;ere selected to produce the pilot tapes and eventually the v;hole TV 
3 

series. 

Content Criteria and Techn ical Q^^lity As sessment Proced ure 

Educational television (KTV; specialists from five State Departments 
of Education in the Appalachian Region arid froni other ETV facilities mot in 
Memphis, Tennessee, in late May, 1973, for the annual conference of the 
SoutJiern Education Coiranuni cat ions Association (SECA) . During a meeting of 
the SECA on May 29, the first of two pilot tapes^ produced by AEL was shov.'n 
to an audience of ETV personnel. The individuals v;ho viewed the tape in 
that rneetincj were asked to rate the tape in tnrms of (i) the degree to which 
the tape met selected content criteria, (2) the technical quality of the tape, 
and (3) Uie suitability of using such tapos at their broadcasting facilities, 
(See Appendix A for the questionnaire.) 

l^hc selected criteria, developed by AEL and validated by a panel consisting 
of such personnel as Robert 'Captain Kangaroo' Kecshan, Dr. Uose MuVerji, 



-^Bertram, Charles L. and others. Appa lachia needs HOPE: Tho need for 
and ca)>a})ility of the Appalachia Educa tional Laboratory to develop a new 
presc hool television pr ogram . Charleston, West Virginia; Appalachia 
Educational Laboratory, Inc., May, 1973. 

^i^ot enough time v;as allocated to tho conference session to pennit 
the shov;ing of both pilot tapes. 
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Dr. Martha Kashid, nr. HerbGrt Spricjlc, and Mr. Euyanc Wenger,^ v;c>ro the 

same criteria pror.onVcid to State Depar tmciit: I':arly Clii Idhood Fdvication ^ 

specialists,^ The questions rolatiiuj to Leclmical quality contalnoJ 17 

catecjorios developed initially by AEL staff men^Jbers and revised slightly 

after coi-^sultation v;ith television experts at klst Century Productions, 

Corrunercial television personnel rated both pilot tapes accordint] to these 
7 

categories . 

There v/ere 2S KTV personnel v;ho viev;od the tape and responded to the 
questionnaire. Of these 25, there v;ere five KTV personnel from Gtate Depart-- 
rnents of Education in the region served by A1::l and 20 from otiier ETV facili- 
ties. The five represented states were Alabama^ Ohio^ Tennsylvariia, Tennesr.er., 
and West Virginia. (Tor specific names of State Departir^ent ETV per::onnal ^ 
see Appendix B.) 

Kesul ts 

The responses tc the variou5; topic areas of the questionnaire will be 
discussed in terms of responses of the five State Dej^artnent ETV personnel and 
then in terras of responses by the total group of 25 ElV personnel. 

Cont erit C riteria. The first part of the questionnaire (items 1-8) dualt 
with the degree to vvhirh the pilot tape met the criteria for selection as an 

^Bertr am, Charles L. Selection of cri teria for the iloiae-Ox i entcd Pre^ichool 
g due a t i o n t ci 1 e v i si on j> c rie ; j and the rating of availcbJc chi Icirc:'^ * tel evi.sicrj 
j^rograias ^'^^f-ordo^Ki to the criter:^a: Tecnni r'al Report ::o . 27. Chr^rleston, V/esu 
Virginia: Appalachia nducationaJ Laboratory, Inc. ,1'layV 1973. 

^Shively, Joe IC , State department early cliildliood e ducat; on procjrai f:>p('cic[l~ 
irjri!_i:'^'-Yfr'?' <^-^ the^content and t.echnical qualiTy -jI' /vliT/Tf '•yrrx^m^^^^ Uio ""Bend" 
P-^ifL^^ii^i '''i^* ^'^£!'*^ ^^'L^ jleport Ijo. 3Q . Charleston, Vsest Virginia: Appalachia 
Educational Laboratory, Inc., May, r973. 

7 

Shrvely, Joe K. Cor^anercial tcIc^yision personnel's reviev;_c>f the^techni^.al 
qjJaJJL ^-y^J^'^d^ ^^i?^^'-J-5'"^^ ^2- S^J.S'^^' * s " Around the Bend" fii lot taper. : ^ Tec'nril cal, 
^i: yp£i"^ *i? P ' Charleston, West Virginia; Appalachia Kducatio/ial LaboratoK'y, 
'l no .' , May', 197 3 . 
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early childhood education program. The KTV specialists VN^ere asked to ratt; 
each of the eight items iu terms of v;h(. :w-r the pilot tape a.) most defiin .cly 
lact, b.) probably mjt , c.) uncertain, d.) probably didn't meet, e.) definitely 
did not meet each of tlie stated criteria. Their responses were then coded in 
a S, 4, 3, 2, 1 fasliion respectively. Table 1 presents the response frequencies 
and moans for each item for the five State Department ETV personnel and Table 2 
presents the response frequencies and means for the total group of 25 ETV 
personnel. 

Table 1 indicates tliat all State Department V/lV personnel in the region 
serviced by I^EL v/ere positively oriented and felt tiiat the tape "most 
definitely" or "probably^^ met the eight criteria, None of the five respoiidcnts 
felt that the tape '^probably didn't'' or "definitely didn't" meet any of the 
eight selected criteria. All eight criteria had a mean scox^e response above 
the ''probeibly so" (4) level. All five KTV personnel felt that the pilot tape 
"most definitely" provided a variation in character images. 

Table 2 indicates that there was some degree of uncertainty among the 
total group of 25 ETV specialists as to v;hether the tcxpe met the criteria for 
selection. T'^'o individuals felt that the tape v;as "probably not" or "definite- 
ly not*' paced appropriately for optimal learning, }]ov;ever, six of the eight 
criteria had mean responses a>3ovo the "probably so" (4) level and the other 
two criteria had mean responses slightly holow this level (3.9G and 3.76) » 

Technical Quality, The second part of the questionnaire dealt with the 
technical quality of the tape. Item 9, v;}:icli dealt exclusively with the 
technical quality, included IG categories for judging specific technical 
qualities and one category for judging overall technical quality. The 25 KTV 
personnel were asked to rate each of the six categories in terms of the pilot 
tape being a,) excellent quality, b,) above average quality, c) average 

ERIC 



Table 1 

Response FrequonclGs and Moans for Criteria for Solocliion 

Appalachian State Oepartment KTV Specialists 

(n - 5) 



Frequericios 



1. Cotitent is acje relevant (3-, 4-^ ana S-year-olds) j 1 4 

2. Consistent with accepted objectives for preschool 
children . 

3. Sequenced accordincj to recoyni^ed principles of 
learning, 

4. Balance of cognitive, affective, rr.otor^ and 
social skills learning. 

5. Paced for optin'.al learning. 

6 . P r o vi d o c. a v a r i a t j o n i n ch a r a c t e r ira age s , 
V. Kinpha:iis on learning rather than entertainment. 
8. Ciiri I'o. integrated with group experience and hoiae 

visitation eleir, jrif; . 
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4.20 
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Table 2 



Response Froqu. 



ies and Means for Criteria for Seidc/tion 
ETV Specialists 
(n - 25) 



Frequencies 



1. Content is aga relcvanc (3-, 4--, anci S^-year-olds) 

2. Consistent with accepted objectives for preschool 
children. 

3. Sequenced according to rccoyni^ed principles of 
learning. 

4. Balance of cognitive, affective, motor, and 
social skills learning. 

5. Paced for optirr.al learning. 

6. Provides a variation in character iraages,. 

7. 'Emphasis on learning rather than entertainment. 

8. Can be integrated v;ith group experience and home 
visitation elements. 



<D 
•H 

a 
o 



4J 

O ^ O 

.Q CJ 
O O 



r { 

O 
M 



4J 
0 

O 
4J 

•H 



9 14 2 



15 3 - 



10 8 - 



11 12 2 - 
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1 1 


3.76 
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4.52 


10 


13 
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1 - 
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11 


13 
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4.40 
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quality, d.) boiow avcracje quality, and o.) unacceptable. Ratings v/ero 
based oa o.g t^ii.:)lishod broadcastiiuj standards. Their responses were then 
ccxled in a 3, 4, 3, 2, 1 fashion respectively. Table 3 presents the response 
frequencies and raeans for eacl) category for tb.e five State Department KTV 
personnel arid Tcible 4 presents the response frequencies and means for the 
total group of 2S ETV personnel. 

Table 3 indicates tiiat 15 of the 16 specific categories attained meaji 
scores between excellent (5) and above average quality (4) » Owly one category 
attained a mean score betv.'ecn above average quality (4) and average quality (3) » 
This category v;as C/vJ-l^lVvS (3.40). One individual indicated that camera shots 
were below average in quality (2) and one individual indicated tl\at SPL'CIAL 
EFFECTS (specifically supers) was belov; average in quality. The OVERALL QUALITY 
was rated betv;een above average and excellent in quality (4.40). 

Table 4 indicates six of the 16 specific categories attained mean scores 
between excellent (5) and above average quality (4) . Of the other ten 
categories v;hich fell between above average quality (4) and average quality (3), 
eight fell at or above a 3, SO level and two fell below, One individual felt 
that the COUTINUITY OF PROGR/^-IMING was unacceptable and one individual felt 
that the GMFHICS was unacceptable. The OVKVsALL QUALITY was rated exactly 
at the above average quality level; 4,00. 

Figure 1 presents a pictorial representation of the data presented in 
Tal>le 1 and Table 2. 

Commercial television personnel ,^ who previously had the opportunity 
to rate both pilot tapes according to these categories, rated the OVERAIiL 

Shivoly, Joe £, Comraercial j^^^jf-^j^g io^ personn el *s rev iew of the Jbechnical 
quality and marketability of AKL/s^'^\round the^ Bencl" pi lot ta]:)es_: ^ TechnicaT~^ 
Repo rt No . 29 . Charleston, U'est Virginia: Appalachia Kducational Laboratory^: ^ 
inc, May, 1973. 
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Kcsponso Froqucncios ^nd Mear.. Jor Technical Quality for Kach Category 
Appalachian State, [JcpartiuGnt KTV SpecialisLs 

(n = 5) 

Fr eque r\ c i c 



C01/}K (balaiice, intensity, use of color) 

LIC:m:;G (adequacy, special uner.) 

CAMVUViS (composition of shot55, novemontr. / 
sequeuco of shotc;, close-ups, 
camera placoraents) 

SKTS AiND SKT DRESSINGS {functional use, 

style, kinds) 

MAKEUP AIJD CCSTUML:s (appropriateness, style) 

SVECIU. LFi:T.cr<; (inserts/ supers) 

FILM SKGMK^^;TS 

i:Dri'S (quality of edit points) ^ 
TR/uMSlTIONS (dissolves, cuts) 

corrriNuiTv OF progh;\m:'Ung (obvious flow) 

SOUND (adequate miking, balance, extraneous 
noise, mixing, synchronization) 

h^USJC (appropriate, underscoring, theme, 
instru.^ontation , selection) 

TALENT (mover;, delivery/ casting, voice) 

PUPPETS (movements, timing^ voices, 

synchronization, setting, appropriateness) 

: ANIMATION (art work, sound, tinging) ; 
" pI^APMICS (titling) o, 
"0 ALL QUALITY 
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Table 4 



Rosponso FrequeiiciGs and Meaiu; for Technical CMalily 
fpr Each Category KTV Specialists 
(n - 25) 
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Figure 1 

Profile of r!oan RcsponKOS to CatogoriCB o^ Technical Quality 
oC the HOPK Pilot Tapoi; by KTV Specialists 
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QUALITY of the tapcG at 3,70. COLOR, LIGHTING, SOUND, and MUSIC all re- 
ceived meuH ratings between excellent and above average quality. CONTIKUITY 
OF PKCX9K.\r'i:'lING received tliG lowest moan rating (2.56) by commercial tele- 
vision personnel. 

g^^^j^l A j ty /ma rke t al3 i 1 i t y . The third part of the questionnaire (itcii^s 
10-12) dealt wiUi the suitability and marketabi Mty of the television series; 
Table 5 (on |;age 12) present? response frequencies and means for the three 
questions dealing with suitability /marketability. The responses were coded 

2, 1, and 0 for each question. Table 5 indicates that the State Department 
E'lV personnel were very positive toward such a series of TV tapes. The 
reaction of the total group of EW specialists, however, was less positive 
than that exhibited just by State Department ETV personnel. One individual 
indicated that he felt that such tapes would not be suitable for use at his 
facility/ yet he indicated that maybe he would be willing to make some effort 
to obtain them. Several individuals did not respond to tliese questions. 
Another individual indicated that such a TV series v;ould not be suitalDle for 
use at her facility because her school telecasting was to a totally urban 
population. 

The final question {item 13) asked for changes or revisions that they 
would Evggest for the television series. Although there were several sugges- 
tions for changes or revisions, most corrcnents fell into four main categories : 
1.) There were several corr^ments about the sequences or situations being 
contrived or unrealistic; 2 J children should be used more frequently; 

3. ) camera techniques and sequencing could be improved; and <J.) vocabulary 
seemed advanced or difficult* 



12 



Table 5 



HcsponsQ Frequoticios and Moanr» for Suitability/Marketability* 

ReaponsG Ciioico {Weight) and 
Quojjtion Frequency of SelGctiou Mean 


10, In your professional 

opinion, will a seric^s 
of IV tapes produced 
by AEL bo suitable 
lor use at your facil- 
ity , assiv:]incj the same 
techniques c.nd pro- 
cedures cire utili'^ed? 


Yes (2) rossibly/Lhic^x^^^^^^ (1) No (0) 
5/16 0/5 0/2 


2, 00/1. 01 


11, Uow v;ouxd tapes such 
as these be received 
in your lucirket area? 


f^nthusiastically {2) So-So (1) Poorly (0) 


2,00/1,56 


4/10 0/8 0/0 


. \ 

12, Would you be v;illing 
to make seme effort 
to obtain these 
tapes? 


Definitely (2) Maybe (1) No (0) 
S/11 0/8 0/1 


2,00/1,50 



*KEY: State Departn\ent KTV/All KTV 
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Suimaary 

In an effort to dotonnii^o if A}:;l has the capabili.ty of produciiuj a TV 
soriGS of high technical quality and whose content meets criteria dcfjicjncd 
for the selection of children 'y television programs, a pilot tape produced 
by AKL v;arv submitted for rating to educational television specialists from 
State Departments of Education serviced by AKL and other ETV facilities. 
Based upon the responses of these individuals to a questionnaire dealing 
with content and technical quality, it appears that hHh has been able to 
demonstrate its capability of producing TV tapes v;hich exhibit technical 
quality and nteet criteria for selection of children's television programs. 

Most of the ETV specialists felt that the pilot tape met the selection 
criteria. They were quite positive about the tape providing a variation in 
character images. Nearly all of the individuals also felt that the tape ex- 
hibited a technical quality which was above average or excellent. Many felt 
that a series of tapes produced by AEL which v;ould be similar to the pilot 
tape v;ould be suitable for use in their states. Several individuals did 
indicate, however, that the child should be emphasized more , that sequences 
or situations were unreal, and that the vocabulary seemed advanced. ElV 
personnel from AEL's geographical region gave more positive ratings to the 
tape than did other EW personnel, but all ratings appeared to be positive. 

Thus, it appears that AEL has produced pilot tapes of high technical 
quality and v;hich meet selection criteria appropriate to children ' s tele- 
vision programs , If AEL is to produce a series of tapes which achieve such 
high ratings , ,then the issues and concerns voiced by these educational tele^ 
vision specialists must be taken into consideration as the new series is 
developed. 
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Responses of EduccitionaJ. Television Personnel 
to AEI/s Pilot Tapes 



Wci arc quite anxious to have your cancjid reactions to the pilot tapes 
prepared for our early childhood program. Please rate Items 1-8 by circling 
the appropriate nuinbers as indicated in the followincj scale : 5 - most 
definitely; 4 - probably so; 3 - uncertain; 2 - questionable (probably 
not) ; 1 - definitely not. 
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1. Content is age relevant (3-/4-, and 5-year olds), 5 4 3 2 1 

2. Consistent with accepted objectives for preschool 5 4 3 2 1 
children, 

3. Sequenced according to recognized principles of 5 4 3 2 1 
learning. 

4. Balance of cognitive, affective, motor, and 5 4 3 2 1 
social skills learning. 

5. Paced for optirrial learning. 5 4 3 2 1 

6. Provides a variation in character images. 5 4 3 2 1 

7. Emphasis on learning rather than entertainment. 5 4 3 2 1 

8. Can be integrated with group experience and home , 5 4 3 2 1 
visitation elements , 
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9, Kate Item 9 according to the follov;incj scala: 5 - excellent quality; 
A - citjQvo averacjo quality; 3 - avoracje quali ty ; 2 - below avorayo 
quality; 1 - unaccoptablo quality, 

lr> in 

^ u u 

CJ o ^i: 

H o 

CJ > u o 

O 0 Q) rH 

X ,q > CJ 

W ^ w 

COLOR (balance, intensity, use of color) 5 4 3 2 

LIGHTI^3G (adequacy, special user;) 5 4 3 2 

CAMERAS (composition of shots, movement:., 5 4 3 2 
sequence o£ shots, close-ups, 
camera placements) 

SETS mo SET DRESSINGS (functional u^e, 5.4 3 2 

style, kinds) 

MAK>:UP A^^D COSTUMES (appropriateness, style) 5 4 3 2 

SPKCIAL F.FrECTS (inserts, supers) 5 4 3 2 

FIU- SfXMEHTS 5 4 3 2 

EDITS (quality of edit points) 5 4 3 2 

TIlAtJSITlOIvIS (dissolves, cuts) 5 4 3 2 

CONTINUITY OF PROGRAMMIMG (obvious flow) 5 4 3 2 

SOUND (adequate miking, balance, extraneous 5 4 3 2 
noise, raixing, synchronization) 

MUSIC (appropriate, underscoring, theme, 5 4 3 2 
instrumentation, selection) 

TALENT (moves , delivery, casting, voice) 5 4 3 2 

PUPPETS (movements , timing, voices, 5 4 3 2 
synchronization , setting, appropriateness) 

ANIMATION (artwork, sound/ timing) 5 4 3 2 

GRAPHICS (titling) 5 . 4 3 2 

OVERALL QUALITY ,5.4 3 2 
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10. In your prof ojisiojuil opinion, v;ill a i^uirios of tolovision tapes produced 
by AHL be auitaVvlo £oi* ur.u at your facility, assvuniiuj that M-.L continues 
to use the same procedures and tec>iniques utilized in the production of 
the pilot tapo:i? Yes No Coifiments 



11, How would tapes such as thef>o be received in your market area? 

3 2 1 

Enthusiastically So-So Poorly 

12, V?ou]d you be willing to raa];o some effort to obtain such tapes? 

3 2 1 

Definitely Maybe No 

13, After viewing the pilot tapes, what changes or revisions would you 
suggest for the television series? ____ ^ 



Name 



Affiliation 



Appendix B 
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State Dopartmont Hducational TolGvision rorsonnel 
f x*oin TOrIL ' s Roqioii 



F.vank Blake 
Jarios Grovor 
Blaze* Gusic 
Chester Hill 
James Stork 



Stat e 
West Virginia 
Ohio 

Pennsylvania 

Tennessee 

Alabama 



mc 



